Knowledge Acquisition by Networks of Interacting Agents 
in the Presence of Observation Errors 
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In this work we investigate knowledge acquisition as performed by multiple agents interacting 
as they infer, under the presence of observation errors, respective models of a complex system. 
We focus the specific case in which, at each time step, each agent takes into account its current 
observation as well as the average of the models of its neighbors. The agents are connected by a 
network of interaction of Erdos-Renyi or Barabasi-Albert type. First we investigate situations in 
which one of the agents has a different probability of observation error (higher or lower). It is shown 
that the influence of this special agent over the quality of the models inferred by the rest of the 
network can be substantial, varying linearly with the respective degree of the agent with different 
estimation error. In case the degree of this agent is taken as a respective fitness parameter, the effect 
of the different estimation error is even more pronounced, becoming superlinear. To complement our 
analysis, we provide the analytical solution of the overall behavior of the system. We also investigate 
the knowledge acquisition dynamic when the agents are grouped into communities. We verify that 
the inclusion of edges between agents (within a community) having higher probability of observation 
error promotes the loss of quality in the estimation of the agents in the other communities. 

PACS numbers: 07.05.Mh, 64.60.aq, 01.40.Ha 



'Knowledge is of two kinds: we know a .subject our- 
selves, or we know where we can find information upon 
it. ' (S. Johson) 



I. INTRODUCTION 

Several important systems in nature, from the brain 
to society, are characterized by intricate organization. 
Being naturally related to such systems, humans have 
been trying to understand them through the construc- 
tion of models which can reasonably reproduce and pre- 
dict the respectively observed properties. Model building 
is the key component in the scientific method. The de- 
velopment of a model involves the observation and mea- 
surement of the phenomenon of interest, its representa- 
tion in mathematical terms, followed by simulations and 
respective confrontation with further experimental evi- 
dences. Because of the challenging complexity of the re- 
maining problems in science, model building has become 
intrinsically dependent on collaboration between scien- 
tists or agents. The problem of multiple-agent knowl- 
edge acquisition andprocessing has been treated in the 
literature (e.g. [ll, 01)j but often under assumption of 
simple schemes of interactions between the agents (e.g. 
lattice or pool). Introduced recently, complex networks 
( [1, 13, S B 0| ) have quickly become a key research area 
mainly because of the generality of this approach to rep- 
resent virtually any discrete system, allied to the possi- 
bilities of relating network topology and dynamics. As 
such, complex networks stand out as being a fundamental 
resource for complementing and enhancing the scientific 
method. 

The present study addresses the issue of modeling how 



one or more agents (e.g. scientists) progress while mod- 
eling a complex system. We start by considering a sin- 
gle agent and then proceed to more general situations 
involving several agents interacting through networks of 
relationships (see Figured]). The agents investigating the 
system (one or more) are allowed to make observations 
and take measurements of the system as they develop 
and complement their respective individual models. Er- 
rors, incompleteness, noise and forgetting are typically 
involved during a such model estimation. The main fea- 
tures of interest include the quality of the obtained mod- 
els and the respective amount of time required for their 
estimation. The plural in 'models' stands for the fact 
that the models obtained respectively by each agent are 
not necessarily identical and will often imply in substan- 
tial diversity. Though corresponding to a largely simpli- 
fied version of real scientific investigation, our approach 
captures some of the main elements characterizing the in- 
volvement of a large number of interacting scientists who 
continuously exchange information and modify their re- 
spective models and modeling approaches. As a matter of 
fact, in some cases the development of models may even 
affect the system being modeled (e.g. the perturbation 
implied by the measurements on the analyzed systems). 

Because interactions between scientists can be effec- 
tively represented in terms of complex networks (e.g. [3, 
m Ej [ill Ei Ej [3)j it is natural to resource to such 
an approach in our investigation. It is interesting to 
observe that the agents may not be limited to scien- 
tists, but can also include intelligent machines and even 
reference databases and libraries. Though most of the 
previous approaches to modeling scientific interaction in 
terms of complex networks have focused on the topol- 
ogy of the collaborations, fewer strategies (e.g. jig) have 
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FIG. 1: Agents (scientists) develop their models of complex systems through observation and interactions. 



addressed the important issue of how the dynamics of 
learning/knowledge acquisition evolves in such systems, 
especially with respect to distinct patterns of connectiv- 
ity between the agents. This is the main motivation of 
the current work. 

This article starts by presenting the general assump- 
tions and specifying and discussing successively more so- 
phisticate levels of modeling. We then focus on the de- 
velopment of a model of a complex system by a team 
of agents interacting through networks of Erdos-Renyi 
(ER) and Barabasi- Albert (BA) types. During estima- 
tion, each agent takes into account not only its observa- 
tion (subject to a probability of error), but also the av- 
erage of the models of its neighbors. In order to quantify 
the performance of an agent, we suggest an individual er- 
ror based on the difference between the model developed 
and the system under analysis. Because the influence of 
an agent is directly related to its degree, the overall error 
of the system is expressed in terms of the mean of the in- 
dividual errors weighted by the degree of each respective 
agent. The obtained results imply a series of interest- 
ing and important insights, such as the identification of 
the substantial role of hubs in affecting the estimation of 
models by all agents: while a linear relationship is identi- 
fied between the overall estimation errors and the degree 



of single agents with different error rates, this relation- 
ship becomes superlinear when the degree of each node 
is considered as the respective fitness. In addition, in 
networks characterized by presence of communities, in- 
tensifying the interactions between agents having higher 
estimation errors in one of the communities undermines 
the performance of the agents in the other communities. 



II. GENERAL ASSUMPTIONS 

The first important assumption is that the complex 
systems under study be representable as a discrete struc- 
ture (e.g. a graph or complex network), and that infor- 
mation about the several parts of this system can be 
observed, often with a given probability of error. By 
agent, it is meant any entity capable of making obser- 
vations/measurements of the system under analysis and 
storing this information for some period of time. There- 
fore, any scientist can be naturally represented as an 
agent. However, automated systems, from measurement 
stations to more sophisticated reasoning systems, can 
also be represented as agents. Actually, even less dy- 
namic systems such as books or libraries can be thought 
of as a sort of passive agents, in the sense that they evolve 



(new editions and versions) as a consequence of incorpo- 
ration of the evolution of knowledge. 

Each agent is capable of making observa- 
tions/measurements of the system under investiga- 
tion. The process of measurement typically involves 
errors, which can be of several types such as observing 
a connection where there is none. Such errors can 
be a direct consequence of the limited accuracy of 
measurements devices as well as of the priorities and 
eventual biases (not to mention wishful thinking) of each 
agent. Several other possibilities, such as the existence 
of non-observable portions of the system, can also be 
considered and incorporated into the model. In addition, 
the model kept by each agent may undergo degradation 
as a consequence of noise and/or vanishing memory. 

A particularly important element in our approach is 
the incorporation of different types of interactions be- 
tween the agents, which can be represented in terms of 
a graph or network (see Figure [T]). In this case, each 
agent gives rise to a node, while interactions (e.g. col- 
laborations) among them are represented by links. The 
single-agent configuration can be immediately thought of 
as a special case where the graph involves only one node 
(agent). Several types of interactions are possible includ- 
ing, but being not limited to conversations, attendance 
to talks or courses (the speaker becomes a temporary 
hub), article/book, reading, and Internet exchanges (e.g. 
e-mailing and surfing). Such interactions may also in- 
volve errors (e.g. misunderstanding words during a talk), 
which can be eventually incorporated into our model. It 
is interesting to observe that the network of interaction 
between the agents may present dynamic topology, vary- 
ing with time as a consequence of new scientific partner- 
ships, addition or removal of agents, and so on. 

Therefore, the framework considered in our investiga- 
tion includes the following three basic components: (i) 
the complex system under analysis S; (ii) one or more 
agents capable of taking observations/measurements of 
the system S (subject to error) and of interacting one 
another; (iii) a network of interaction between the 
agents. In the following we address, in progressive lev- 
els of sophistication, the modeling of knowledge acquisi- 
tion/model building in terms of complex networks con- 
cepts and tools. 



III. SINGLE-AGENT MODELING 

A very simple situation would be the case where a sin- 
gle agent is allowed to observe, in uniformly random fash- 
ion, the presence or not of connections between all pairs 
of nodes of the complex system being modeled. The ob- 
servation of each edge involves a probability 7 of error, 
i.e. observing a connection where there is none and vice- 
versa. A possible procedure of model building adopted 
by the agent involves taking the average of all individual 
observations up to the current time step T , i.e. 
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(1) 



where x is the value of a specific edge (0 if non-existent 
and 1 otherwise) and Xt is the observation of x at time 
step t. Observe that we are considering the observation 
error to be independent along the whole system under 
analysis. Let us quantify the error for estimation of any 
edge, after T time steps as follows 



e(x)T = \x* - {x)j,\ 



(2) 



where a;* is the original value of that edge. It can be 
easily shown that 



lim e{x)T = 7 



(3) 



Because the observation error is independent among 
the pairs of nodes, the average of the errors along the 
whole network is identical to the limit above. 

Thus, in this configuration the best situation which 
can be aimed at by the agent is to reach a representation 
of the connectivity of the original complex system up to 
an overall limiting error 7, reached after a considerable 
period of time. Though the speed of convergence is an in- 
teresting additional aspect to be investigated while mod- 
eling multi-agent knowledge acquisition, we leave this de- 
velopment for a forthcoming investigation. 



IV. MULTIPLE-AGENT MODELING 

We now turn our attention to a more interesting con- 
figuration in which a total of Na agents interact while 
making observations of the complex system under anal- 
ysis, along a sequence of time steps. As before, each 
agent observes the whole system at each time step, with 
error probability 7. In case no communication is avail- 
able between the agents, each one will evolve exactly as 
discussed in the previous section. However, our main 
interest in this work is to investigate how interactions 
and influences between the multiple agents can affect 
the quality and speed at which the system of interest is 
learned. The original system under study is henceforth 
represented in terms of its respective adjacency matrix 
A^,. We also assume that the agents exchange informa- 
tion through a complex network of contacts. 

One of the simplest, and still interesting, modeling 
strategies to be adopted by the agents of such a sys- 
tem involves the following dynamics: at each time step 
t, each of the agents i observes the connectivity of the 
complex system with error 7, yielding the adjacency ma- 
trix O* , and also receives the current matrices from each 
of its immediate neighborsj (i.e. the agents to which it 



is directly connected). The agent i then calculates the 
mean matrix (K) of the matrices if *j received from all 
its neighbors j, i.e. 
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where ki is the degree of the agent i. The agent i then 
makes a weighted average between its current matrix Kj 
and the immediate neighbors mean matrix, i.e. 



^{a{K}' + il-a)Kl), 



(5) 



where < a < 1 is a relative weight. We henceforth 
assume a — 0.5, so that w* becomes equal to the average 
between its current matrix and of the neighbors at that 
time step. Each agent i subsequently adds this value to 
its current observation, i.e. 
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so after T time steps the estimation of the adjacency 
matrix by the agent i can be given as 



A. 



m _ T^(T) 



KY'/T. 



(7) 



This simple discrete-type dynamics has some immedi- 
ate important consequences. Because each node receives 
estimations from its neighbors at each time step, an al- 
tered quality of estimation is obtained. Indeed, by av- 
eraging between its current observation and the mean 
estimation from the neighbors, even the limit error may 
be actually modified with respect to the single agent sit- 
uation. 

Several variations and elaborations of this model are 
possible, including the consideration of noise while trans- 
mitting the observations between adjacent agents, forget- 
ting, the adoption of other values of a, as well as other 
averaging and noise schemes. In this article, however, 
we focus attention on the multi-agent model described 
in this section with error being present only during the 
observation by each agent. In the remainder of our 
work, we report results of numerical simulation consider- 
ing three particularly important situations: (i) multiple- 
agents with equal observation errors; (ii) as in (i) but 
with one of the agents having different observation er- 
ror; and (iii) multiple-agents scheme applied in networks 
with community structure and one of the communities 
having higher error rate. Interesting results are obtained 
for all these three configurations including the analytical 
solution of the overall behavior of the system. 



V. CASE EXAMPLES: RANDOM AND 
SCALE-FREE NETWORKS OF AGENTS 

In this section we investigate further the dynamics of 
multi-agent learning by considering theoretical simula- 



tions performed with a fixed collaboration network. We 
assume that the agents collaborate through a uniformly 
random model (ER) as well as a scale- free model (BA), 
both containing 50 nodes and average degree equal to 
9.4. For simplicity's sake, we consider only a single real- 
ization of such a model in our subsequent investigation. 
The performance of each agent is quantified in terms of 
the error between the original network and the models 
obtained by that agent after a sufficiently large number 
of time steps (henceforth assumed to be equal to T = 300 
time steps). This error is calculated as 
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where Ai is the adjacency matrix representation of the 
model of agent i at time step T. The original network 
to be learnt by the agents is a Barabasi- Albert network 
containing A^ = 50 nodes and average degree equal to 
6, represented by the respective adjacency matrix A*. 
The overall performance of the network, including all its 
agents, is henceforth expressed in terms of the average 
of the above error weighted by the degree considering 
all agents, which is here called the overall error of the 
system: 
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Because the influence of an agent in the network is cor- 
related with the number of its neighbors, such a defini- 
tion of the overall error takes into account the respective 
importance of the models of each agent. 



A. Analytical Description 



We now present the mathematical formalization of the 
above concepts. We start with the difference equation 
that characterizes the dynamics of each agent i: 
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Kl + 20* 



(10) 



where Kl is the current matrix and 0\ is the observa- 
tion of the agent i at time step t. The term in brackets is 
the mean of the matrices received from the set F of the 
neighbors of i. Now we consider the continuous approxi- 
mation given by: 
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Dividing by t and knowing that j^Ki(t) = Jj ( -j^ ) + 



jjKf, we have 
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and adding, for every agent i 



for both cases. The term in the sum is precisely the in- 
dividual error of an agent i weighted by its degree. Then, 
dividing by the sum of the degrees, we have the analytical 
expression for the overall error of the system. 
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Finally, we define 
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For an agent i the probability of observing an edge 
where there is none and vice- versa is 7^. So, for an entry 
A™'" of the system under observation: 



lim 



^jh2k,OT^"it)]dt 






(15) 



Applying this result in equation [TJ] and solving, we 
have : 
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and subtracting ^^ fc^A™'" and adding for all m and n 
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(17) 



We can apply this result in two following situations, 
assuming a network of agents with average degree (fc) 
and maximum and minimum degree equal to maxd and 
mirid, respectively: 

a) One agent j with degree kj having an observa- 



tion error 7^ 
rate 7: 



E' 



pj and all other agents with an error 
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which is a linear relation with respect to the degree of 
the agent with different error rate. Note that, there is 
no difference between any two networks of agents with 
the same average degree and number of vertices. 

b) One agent j with degree kj having an observa- 
tion error proportional to its degree "fj{'j > 7j > 1) and 
all other agents with an error rate 7; 



=> E'^ = ^^ 
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(20) 



which is a power-law relation with respect to the degree 
of the agent with different error rate. 



Fixed Observation Errors 



In this first configuration, all nodes have the same es- 
timation error 7 = 0.2, and therefore the same infiu- 
ence, over the averages obtained by each agent. How- 
ever, nodes with higher degree, especially hubs, are still 
expected to infiuence more strongly the overall dynamics 
as a consequence of the fact that their estimated mod- 
els are taken into account by a larger number of neigh- 
bors. Figure [21 shows the distribution of the average of 



the errors ef obtained for this case in terms of the re- 
spective degrees. As could be expected, the errors ob- 
tained among the agents are very similar one another. 
Thus, there is no major difference in the learning quality 
among the agents. A rather different situation arises in 
the next sections, where we consider different error rates. 
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FIG. 2: The individual estimation errors in terms of the de- 
gree of the agents obtained for the Erdos-Renyi (ER) and 
Barabasi-Albert (BA) models with Na = 50 and (fc) = 9.4. 



C. Varying Observation Errors 



We now repeat the previous configuration in two new 
situations: (i) one of the agents having half or twice the 
error rate of the others; and (ii) having an error pro- 
portional to its degree. Simulations are performed inde- 
pendently while placing the higher error rate at all of the 
possible nodes, while the respective overall errors are cal- 
culated. In addition, we compared the behavior for the 
Erdos-Renyi (ER) and Barabasi-Albert (BA) network of 
agents. 

Figure [3lja) shows the results obtained while consider- 
ing error probability equal to 0.2 for one of the agents 
and 7 — 0.4 for all other agents. It is possible to identify 
a substantial difference of the mean quality of the mod- 
els which depends linearly on the degree of the node with 
different error rate. More specifically, it is clear that the 
overall errors are much smaller for nodes with higher de- 
grees. In other words, the best models will be obtained 
when the hubs have smaller observation errors, infiuenc- 
ing strongly the rest of the agents through the diffusion, 
along time, of their respectively estimated models. 

Figure El^b) shows the results obtained when the es- 
timation error of one of the agents is 0.4 while the rest 



of the agents have error rate 7 = 0.2. The opposite ef- 
fect is verified, with the overall error increasing linearly 
with the degree of the node with higher estimation error. 
Moreover, as expected, no difference was found between 
the ER and BA models in both cases. 

Figure |4] shows the results obtained when one of the 
agents has a higher error rate than the others, and pro- 
portional to its degree. Results similar to the previous 
case were found, but with a nonlinear behavior. In addi- 
tion, accordingly with the analytical predictions, a sep- 
aration was verified between the ER and BA networks 
(ER presents higher values than BA). This means that 
when we consider two nodes with the same degree, each in 
one network, the overall error is lower for the BA model, 
since their hubs influence more strongly the to increase 
the quality of the estimated models. 

A better picture of the influence of the degree over the 
model development by other agents is provided in Fig- 
ure [5] respectively to the situation having twice the error 
probability (7^ = 0.4) for the agent j with the highest 
degree. Figures EJa) and ^c) consider the ef of indi- 
vidual agents in terms of their respective degrees for the 
BA and ER models, respectively. It is clear from these 
results that the degree of the differentiated agent affects 
the estimation of the whole set of agents, especially for 
its neighborhood, shifting substantially the average in- 
dividual errors. Observe also that, in both cases, the 
largest individual error results precisely at the less accu- 
rate agent. Furthermore, nodes with high degrees tend to 
be less influenced by the agent with different error rate. 

Figures E^b) and Eljd) complement the analysis con- 
sidering the mean value of the individual errors of agents 
with the same topological distance from the agent with 
different error probability. The results show that the 
closer agents tend to be more affected than the periph- 
erals. 

From the results above, we immediately verify that 
the presence of the less accurate agent produces a non- 
uniform error distribution. Since the individual error of 
an agent is produced by averaging between its model and 
the mean estimation from the neighbors, the direct con- 
tact (and proximity) with agents with higher error rates 
alters considerably its final model. Moreover, this effect 
is more strongly felt by agents with few connections. 

Figure [6] shows the standard deviation of individual er- 
rors in terms of the degrees of the agents with different 
error rate for the three situations above. Differently from 
the first two situations (figures [DJa) and [D^b)), we de- 
tected a positive correlation when one agent has an error 
rate proportional to its degree (figure Efc)). 



D. Varying Observation Errors in Communities 

We also applied the knowledge acquisition dynamics 
to a network of agents with community structure. Dur- 
ing the simulations all agents of one of the communities 
have twice the error rate of the others. We are interested 
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FIG. 3; The overall estimation errors in terms of the degree of the agents with different error rates for ER and BA models: (a) 
one agent with an error rate equal to 0.2 and all other agents with 7 — 0.4; and (b) one node with 0.4 and all other nodes with 
7 = 0.2. The dashed line represents the analytical solution. 





1.50 




1.4S 




1.40 




1.3S 


^^ 


1.30 






}J 


lai 






UJ 


1^ 






s 


1.1s 



X BA 
ER 

TTieorelical prediction for BA 

, Tlieorefical prediaion tor ER 




10 12 14 is IS 20 22 24 
Degree 



nities is 0.4, the agents of other communities have error 
0.2. We find a positive correlation which means that the 
addition of edges between the agents with higher error 
rates increases the individual errors of the agents of the 
other communities. 

This effect can be explained by the existence of bridg- 
ing agents which belong to the community with higher 
error rate but connect to another clusters. Because the 
individual errors takes into account the models of the 
neighborhood, these special agents tend to reach worse 
models when the intra-community communication is in- 
tensified. Indeed, the addition of new edges impfies more 
agents with higher errors to influence to the development 
of their estimations. Consequently, the loss of perfor- 
mance propagates to another communities. 



FIG. 4: The overall estimation errors in terms of the degree 
of the agents with higher error rates: one agent with an error 
proportional to its degree and all other agents with 7 = 0.2. 
The dashed and straight lines represent the analytical solution 
for the ER and BA models, respectively. 



in obtaining the correlations between the average degree 
of the community with higher error rate and the mean 
value of the individual errors of the agents of the other 
communities. Figure [7] shows the results for a network 
with Na = 100 agents and 5 communities of the same 
size. While the estimation error of one of the commu- 



VI. CONCLUDING REMARKS 

The important problem of scientific interaction has 
been effectively investigated in terms of conce pts and 
tools of complex networks research (e.g. [3, 0, [13, [HI, 
[l2 . llSJI). However, most of the interest has been so far 
concentrated on characterizing the connectivity between 
scientists and institutions. The present study reported 
what is possibly the first approach to model the dynam- 
ics of knowledge acquisition (building a model of a com- 
plex system) by a system of multiple agents interacting 
through specific types of complex network. Several con- 
figurations were considered at increasing levels of sophis- 
tication. Each agent was assumed to make an observa- 
tion of the system of interest at each time step with error 
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FIG. 5: The individual estimation errors in terms of the degree of the agents (a and c): D, the agent with highest error rate; 
• , the neighborhood of the agent with different error rate. Figures (b and d) show the mean value of the individual errors of a 
set of nodes with the same topological distance from the agent with higher error rate. Simulations for the ER and BA models 
with Na = 300 and (k) = 4.7. 



probability 7. 

A series of interesting and important results have been 
identified analytically and through simulations. First, we 
have that the individual estimation error tends to 7 when 
the agents do not interact one another. However, differ- 
ent individual errors were observed when the agents were 
allowed to consider the average of models at each of their 
immediate neighbors. Special attention was given to the 
cases in which one of the agents has a different observa- 
tion error, yielding the important result that the overall 
error in such a configuration tends to be correlated with 
the degree of the agent with different observation error. 
More specifically, we demonstrated that this correlation 
is linear when one agent has an error half or twice the 



error rate of the others, and nonlinear when it is propor- 
tional to its degree. In other words, the connectivity will 
have a substantial influence over the models developed 
by the agents, for better or for worse. It is interesting 
to observe that agents with many connections will im- 
ply strong influences over the whole network even in case 
those agents have no special fitness. Such an effect is a 
direct consequence of the fact that those agents are heard 
by more people. In case the hubs have higher observa- 
tion errors, worse models are obtained throughout the 
agents network. In particular, the negative influence of 
the hubs is more strongly felt by its neighborhood. Fi- 
nally, we have shown that when the agents are clustered 
into communities, the addition of edges in the communi- 
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FIG. 6: The standard deviation of individual errors in terms of tiie degree of tlie agents with different error rates: (a) one agent 
with 7 — 0.2 and all other agents with 0.4; (b) one node with 7 — 0.4 and all other nodes with 0.2; and (c) one agent with an 
error proportional to its degree and all other agents with 0.2. 
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tics with different error rate leads to the change of the 
individual errors of the agents in the other groups. 



This investigation has paved the way to a number of 
subsequent works, including but not being limited to: 
consideration of model degradation along time, other 
learning strategies, other types of networks, observation 
errors conditional to specific local features (e.g. degree 
or clustering coefficient) of the network being modeled, 
as well as other distribution of observation errors among 
the agents. 
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